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Abstract —We consider signal reconstruction problem for sig¬ 
nals F of the form F{x) = (x) = o,j5 {x — Xj) , from their 

Fourier transform F{F){s) = F{x)e~'“’^dx. We assume 

F{F){s) to be known for each s G [—A, A], with an absolute 
error not exceeding e > 0. We give an absolute lower bound 
(which is valid with any reconstruction method) for the “worst 
case” error of reconstruction of F from F(F) , in situations where 
the nodes Xj are known to form an I elements cluster of a size 
/i <C 1. Using “decimation” algorithm of Q, p) we provide an 
upper bound for the reconstruction error, essentially of the same 
form as the lower one. Roughly, our main result states that for 
h of order the worst case reconstruction error of the 

cluster nodes is of the same order and hence the inside 

configuration of the cluster nodes (in the worst case scenario) 
cannot be reconstructed at aU. On the other hand, decimation 
algorithm reconstructs F with the accuracy of order 

I. Introduction 

In this paper, we provide lower and upper bounds for the 
Eourier reconstruction error, in the presence of noise, of spike- 
train signals in the case of “almost colliding” (or clustering) 
nodes. The lower bound is obtained via the analysis of the 
behavior of the Eourier transform under perturbation of the 
nodes and amplitudes in the cluster, and so it is valid (in the 
worst case scenario) for any reconstruction method. The upper 
bound follows from the accuracy analysis of “decimation” 
reconstruction algorithm, as given in B Q- 

We hope that our analysis may clarify some aspects of the 
“Super-resolution problem” for spike-train signals with clus¬ 
tering nodes, as it appears in many old and recent publications 
on the subject (see, as a very small sample, | , 117 , 

, 1^, recent publications Q-GT), , p, 

, 1^, and references therein). 

Let us assume that the signal F{x) is a spike-train, i.e. it 
is a priori known to be a linear combination of d shifted 6- 
functions: 

d 

F{x) = Fa,x (x) ='^ajS {x - Xj), (1) 

i=i 


|21 , |22 



where A = {ai,...,ad) G X = Xa = [xi,...,Xd) G 
We shall always assume that Xi < X 2 < ■ ■ ■ < Xd- As for 
the measurements, we assume that the Eourier transform 

/ OO 

( 2 ) 

-OO 

is known for each s G [—A, A], with an absolute error not 
exceeding e > 0. So our input measurement is a function $(s) 
satisfying |$(s) — F{F){s)\ < e for s G [—A, A]. 

The hrst goal of the present paper is to study the “worst 
case” accuracy of reconstruction of F from <h(s) in situations 
where the nodes Xj are known to form a cluster of a size h <C 
1, while being near-uniformly positioned inside the cluster. We 
give an absolute lower bound for the reconstruction error of 
the nodes xj from the measured function $(s), which is valid 
independently of the reconstruction method applied. 

Our second goal is to give an upper bound for the recon¬ 
struction error of the nodes Xj, under the same assumptions as 
above. We show that the decimation algorithm, combined with 
a homotopy continuation solving of the resulting algebraic 
equations, as described in produces an error of 

essentially the same order of magnitude as the lower bound. 

Shortly, our main result is as follows: 

1. If certain I nodes of F form a cluster of a size h ~ 
while being near-uniformly positioned inside the cluster, then 
the worst case reconstruction error A of the cluster nodes is 
at least Ch. 

2. If for the same signal F the measurements error is smaller 
than ei ~ then the decimation algorithm reconstructs 

the cluster nodes with the error A being at most ch, c C. 

The “practical” conclusion could be that the inside configu¬ 
ration of the cluster nodes cannot be reconstructed at all from 
the Fourier transform F{F){s), known with the error e, for 
s G [—A, A], if the cluster size h is smaller than F^ 2 i-i _ 
However, slightly reducing (to ei) the allowed magnitude 
of the measurements error, we can accurately and robustly 
reconstruct the cluster nodes via the decimation algorithm. 







The reconstruction error A ^ would make practical 

reconstruction of two colliding nodes very difficult, and of 
three or more virtually impossible. However, our bound is the 
worst case one, and one can hope that for a random noise a 
typical reconstruction accuracy may be much better. 

Let us stress that our result is pretty close to the main result 
of 1131, where Fourier sampling of atomic measures on non- 
uniform grids is studied. In particular, the connection of the 
form e = between the noise, the bandwidth, and 

the clustering geometry which can be stably recovered, appears 
also in GD- Very recently similar bounds were obtained 
for superresolution of positive sources in p2] , and for a 
Fourier recovery of sparse vectors in m- There are also 
apparent similarities with the classical result of Slepian in 
124) . Compare a discussion in 0 of the role of sparsity and 
clustering, as they appear in the superresolution problem, and, 
in particular, the discussion in Sections 1.7 and 3.2 of Q of 
the “absolute lower bounds” for the reconstruction error. We 
plan to further investigate the above connections. 


II. Main result 

To state our results we have to make some “normalizing” 
assumptions on the signal F to be recovered. Indeed, if some 
amplitudes aj are small, the reconstruction accuracy of the 
corresponding nodes drops, while larger aj imply higher accu¬ 
racy. So we shall assume that the amplitudes A = (oi,..., ad) 
of the signal F satisfy the following assumption A{m,M): 


Q < m < \aj \ < M < c», j = 1,..., d. 

Definition 2.1: A signal Fa.x as given by 0 is said to form 
an (^, h, p)-cluster X if there is an interval / C K of length h 
which contains exactly I nodes Xi = ... ,Xk,+i-i} 

of F, while the minimal distance between the nodes in Xi is 
at least ph, p > 0. 

Definition 2.2: For two ordered subsets V = (ui,... ,Ug), 
and W = (wx,..., Wq) in M the distance d{V, W) is defined 
as 


d{V, W) = max^^;^|us - Ws\ 


Ps - Ws 1/“ > 


> 




The following theorem is the first main result of the paper; 
Theorem 2.1: Let a signal = Fao^x«, satisfy¬ 

ing assumption A{m,M), form an (/,/i, p)-cluster = 
Then there exist parameters A^,X^, 
satisfying assumption A{y,2M), such that the distance 
between X° and X/ = 

is at least Cih, while for F^ = F^-^.x^, and for each s G M 
with |s| < we have 


\F{F°)is) - F{F^){s)\ < (3) 

In particular, for s G [—X, iV], N < this difference 

does not exceed C 2 {hN)‘^^~^. Here the constants Ci and C 2 
depend only on m, M, I, p. 


The proof of Theorem 2.1 is given in Section III below. 


From this result we immediately deduce the following; 

Corollary 2.1: Assume that the noise N{s) in the Fourier 
sampling F{s) on [—N, X] may be an arbitrary function with 
the only restriction that |iV(s)| < e, where 0 < e <C 1, and put 
he = Let F^ be any signal, satisfying assumption 

A{m,M), and forming an (Z, ft,,:, p)-cluster X°. Let F ^ be 
the new signal produced from F*’ as in Theorem 2.1 Then 
for any reconstruction algorithm IZ the worst-case error in 
reconstruction of the nodes of either X°, or of X^ is not 
smaller than ^Cihe. 

Proof: We pick an “adversary” noise N{s) to be identically 
zero for the sampling of F° and to be equal to N{s) = 
F{F^){s) — F{F^){s) for the sampling of F^ In both cases, 
by our choice of he and by Theorem 2.1 we have |X(s)| < 
e, s G [—X, X]. Notice that for sufficiently small e we have 
he ^ and hence the condition X < 2 ^ of Theorem 
2.1 is satisfied. The measurement results 4)(s) are identical 
for F° and F^, and whatever reconstruction {A,X) of the 
signal parameters the algorithm IZ produces from $(s), either 
the distance d{Xf , X;), or d{Xl,Xi), is at least ^d{Xi , X^) 
which, by Theorem 2.1 is not smaller than fCift^. □ 

As for the upper bound on the reconstruction error, we 
announce the following result; 

Theorem 2.2: Let a signal F° = F^o xo, satisfy¬ 
ing assumption A{m,M), form an (Z, ft, p)-cluster X^ = 
{x°, ..., Let the measurements error e satisfy 

e < ei = C' 3 (ftX)^ft Then solving the corresponding deci¬ 
mated Prony system of |[^ produces the reconstructed cluster 
nodes X° with the error at most ^ph, i.e. cZ(X°, X°) < ^ph. 

In particular, since by the assumptions the distance between 
the cluster nodes is at least ph, the number of the nodes, and 
the inner geometry of the cluster can be robustly restored. 

The proof of Theorem |2.2| is based on a combination of the 
Jacobian estimates in ||^, Q with the “Quantitative Inverse 
Function theorem” (Theorem 3.2 below). We plan to present 
the details separately. 

HI. Proof of Theorem I2.1I 


We prove Theorem 2.1 in several steps. First, for signals F 


as above we express the Fourier transform F{F) through the 
moments mk{F). 

A. Fourier transform F{F) and moments mk{F) 

For signals F of form ([T|) their Fourier transform F{F) 
can be easily computed explicitly. Let the moments mk{F) 
be defined by 


mk{FA,x) = j^^x^FA,x{x)dx = 

= fc = 0,1,.... 

Proposition 3.1: For F = Fa,x = J^j=i aj^(x — Xj) 
have 


( 1 ) 


F{F){s) = ^ where s = —2Tris. (2) 

k=0 












Proof: 


jr(F)(s) = e-‘^”^^F{x)dx = = 

= E,ti«,Er=oM(-2-**.^)'= = 

= Er=oM(-2-*5)'=E,tia.^,^ = 

= J2‘k=0 W.^kiF^ ■ O 

Thus the Taylor coefficients of the Fourier transform 
F{F){s) are the consecutive moments mk{F) divided by kl 
This fact provides us an “Algebraic-Geometric” approach to 
the Fourier reconstruction; to produce the signal F^ starting 
with we analyze the behavior of the moments mk{F), and 
keep them the same for and F^ for fc = 0,1,..., 2f — 2. 
This analysis strongly relies on recent results in Q, Q, Q 
on the geometry of the “Prony mapping”, which is formed by 
the moments mk{F). 


B. Reduction of Theorem 2.1 to a geometric lemma 


The following result is proved in Section III-C below: 

Lemma 3.1: Let a signal = F^o xo, satisfying assump¬ 
tion A{m, M), form an (d, 1, p)-cluster = {x \,..., x^}. 

In other words, all the d nodes of are p-uniformly 

distributed in the interval [—^]. Then there exist parame¬ 
ters A^,X^, satisfying assumption A{ff,2M), with = 


(a 


1) ■ 


\) C [—1,1], such that 


1. The distance d{X'^,X^) between the nodes sets and 
X^ is at least Ci{m, M,d) > 0. 

2. mk{F^) = mk{F^), k = 0,1,..., 2d — 2, where Fi = 
Pa^.x^- 

Now we can complete the proof of Theorem |2.1| Let a 
signal = F^o^xo, satisfying assumption A{m,M), form 
an {I, h, p)-cluster = (a;°, , x^^i_.^). We rescale 

the cluster AT^ to Xj^ in the interval [—with the same 
amplitudes A^. Then we apply Lemma 3.1 (where we put 


d = 1), and find the amplitudes Aj and the nodes X'^ in 
the interval [—1,1], with the same moments as up to 
21 — 2. Applying the inverse scaling, and obtain the cluster 
Xl C [—h,h]. Clearly, if the moments were equal before 
shrinking, they will remain equal afterwards. We extend the 
cluster xl with the amplitudes Aj to the required parameters 
A^,X^, adding the non -clus ter nodes of X^ with their original 

the distance d{Xl,Xl) is at least 


3.1 


amplitudes. By Lemma 

Cih, while mk{F^) = mk{F^)^ fc = 0,1,..., 2Z — 2. 

It remains to show that j — -^(.^4 x)(s)| < 

C 2 {hs)^’‘~^. By Proposition 3.1 we have 


FiFA,x){s)-P{FA,xM = Y.^~s^ (3) 

k=0 

where 7 ^ = rnk{FA^x) — trik{FA x)^ ™tl s = —2xis. But 
by our construction 7 fc = 0, k = 0,1,..., 2f — 2. On the 
other hand, since both Xi and Xi are inside [—h,h], while 
the amplitudes are bounded by 2M, we have for any k that 
l7fe| < := So in fact, for jsj < we get 


00 ^ 

\P{Fa,x){s)-P{Fa^x){s)\< E 

k^2l-l 

00 - 

< C3(27rs/i)2'-i E < 

where we put C 2 = completes the proof of 

Theorem 12.11 □ 

C. Proof of Lemma \3.1\ 

Let a signal = Fao^x’^j satisfying assumption A{m, XI), 
be given, such that all the d nodes of F are p-uniformly 
distributed in the interval [—^]. We have to show that there 
exist parameters A^,X^, satisfying assumption A{ff ,2X1), 
with X\ = {x\,...,x]f) C [—1,1], such that the system of 
equations 

mfc(F0) = mfc(Fi), 

fc = 0, l,...,2d-2 

is satisfied, while the distance d{X^,Xli) is at least 
Ci{m, XI,d) > 0. In other words, we have to show that the 
projection of the set Q xR‘^ consisting of A^,X^ which 
satisfy is large enough. 

Let us recall a definition of the Prony mapping PXI : x 

given in ijsj. It is provided by 

PXI {A, X) = {moiFA,x), ..., m2d-iiFA,x)) G (5) 

Put ml = mk{FA,x)- Then PX1{A^,X°) = 

(toq, m®,..., rn 2 d_i)- We shall denote by 

/i= {fj.0, . . . , H2d-l) = 

= (mo-m[], mi-ml, ..., m2d-i - 

the coordinates in with the origin shifted to fjP = 

PM (A°, The following result can be easily derived from 
Theorem 4.5 of 0: 

Theorem 3.1: At each point S x sat¬ 

isfying conditions of Lemma IE] the Jacobian JPM = 
JPM{A^,X^) of the Prony mapping PM is invertible, 
the norm of its inverse JPM~^ is bounded from above 
by the constant C^{m,M,d, p), and for each p G 
we have \\JPM~^{p)\\ > C'eH/rH, with a positive Cq = 
Ce{m,M, d,p). 

Let L = Op 2 d-i be the last coordinate axis in and let 
Px ^ 

denote the projection of the signal parameters A, X to the 
nodes coordinates AT. Then for each p G L we have 
||P o JPM~^{p)\\ > Cyll/rll, with a positive Cr = 
C'7(m, M, d, p). 










Proof: The first three statements of Theorem ITT] follow 
directly from Theorem 4.5 of 0 - The last statement follows 
from the fact that for the fixed nodes the restriction of the 
hrst d coordinates of the Prony mapping PM, and hence, of 
its Jacobian JPM, to the coefficients ^ is a non-degenerate 
linear mapping to with the Vandermonde matrix on 
the nodes X. Hence, the pre-image JPM~^{L) cannot be 
contained in x {0} C x Otherwise at least one 

of the first d moments would change along L. In fact, it is 
easy to show that the line JPM~^{L) forms a positive angle 
with X {0}, which is bounded from below by a constant 
depending only on m, M, d, p. But this is equivalent to the 
last statement of Theorem 13.11 □ 

On the other hand, using the standard solution procedure of 
the Prony system, one can easily show the following fact: 

Proposition 3.2: There are constants Ri = Ri{m, M,d, p) 
and Cs = C^ijn, M, d, p), such that for e ach p oint X°) S 
X satisfying conditions of Lemma |Tl] the first and the 
second derivatives of the Prony mapping PM are bounded by 
Cg in the ball Bji^ in x centered at 
With these two preparatory results we now apply the following 
“Quantitative Inverse Function Theorem” (see. e.g. p5)): 

Theorem 3.2: Let G : —>■ (M^jO) be a twice 

differentiable mapping of the unit ball at the origin in K"* 
to K™, with G(0) = 0, such that the Jacobian J = JG{0) is 
invertible, and ||J“^|| < Ki < oo. Assume that the second 
derivatives of G are bounded by K 2 in the ball BJ". Then 
the inverse mapping G~^ exists in the ball B^^ of radius R 2 , 
centered at 0 S K™, and satishes there the condition 


mfe(BO) = mfc(Bi), fc = 0,1,..., 2d - 2. (9) 

On the other hand, = P{PM~^{p})) = P{J~^{p^) — w), 
where w = J~^{p^) — PM~^{p,^\and hence, by 0 , we have 
||w|| < GioIIm^IP = Ciop'^. By ^ we get \\P o J-^{p^)\\ > 
Clip, and therefore 


Ill'll = - ^«)ll > Cnv - GioV^ = 

= v{Cii - Giop) > rj^ := C12. 


The norm ||X^|| of X^ here is the norm with respect to 
the coordinates in centered at X^. Hence ;^||X^|| bounds 
from belo w the distance d{X^, This completes the proof 

of Lemma 


3.1 


with Cl = ^Gi 2 . □. 


Remark. In this paper we consider only the curve PM~^{L) 
where the hrst 21 — 2 moments take equal value. In the 
direction of this curve the magnihcation of the measurements 
error is maximal. In fact, for each q = 1,... ,21 — 2 there is 
a stratum in x of dimension 2 / — q — 1 , where the 
hrst q moments rrik take equal value. In the direction of this 
stratum the error magnihcation is of order q-|-1. The geometry 
of the strata Eg plays important role in the understanding of 
the error magnihcation patterns which occur in the Fourier 
reconstruction of spike-trains. We plan to present the results 
in this direction separately. 


||G-i(a:) - J-\x)\\ < Cg{m,Ki,K 2 )\\x\ 


for X £ B 


( 6 ) 




with R 2 = B 2 (m, Ki,K 2 ) and Gg = Cg{m, Ki, K 2 ) depend¬ 
ing only on m,Ki, and K 2 . 

We apply Theorem |3.2| properly rescaled, to the the Prony 
mapping PM in the ball B^^ in centered at (A°, X°), 


with the bounds provided by Theorem 3.1 and Proposition 


3.2| We conclude that in the ball B ^3 of radius B 3 at the 

the inverse PM~^ exists 


point = PM{A°,X^) 
and satishes 


\\PM-\p) - J-\p)\\< CioMl^ (7) 


where J = JPM is the Jacobian of the Prony mapping PM 
at and the constants B 3 and Gio depend only on 


TO, M, d, p. 

From the last statement of Theorem 3.1 we get for /r € B = 
Op2d-l 


||Bo J-i(p)|| >Gn||Mll, (8) 

with P the projection of the signal parameters A, X to the 
nodes X, and Gn = Cii(m,M,d, p) a positive constant. 

Finally we put = (0, ...,0,p), with 77 = 

min (i? 3 , 77^)^ and take {A^,X^) to be the inverse image 
PM~^{p^). By the construction we have 


Some examples 

The following examples illustrate the shape and behavior of 
the signals and F^, q = 1,3, 5, for which the difference 
DFq{s) = F{Fq){s) — F(Fq)(s) between their Fourier 
transforms is of order q in s. As it was explained above, 
the geometry of the strata Eg, containing Fg plays important 
role in the error magnihcation which occurs in the Fourier 
reconstruction of spike-trains. 

We consider signals with d = 3 nodes of the form 0 : 
Fq{x) — o.qj5{x — Xqj). Theh specihc parameters are 

shown in table |I] In this table we assume h to be hxed, and put 
7] = fjh, with fj being the “free parameter along the stratum 
Eg”. The maximal distance between the nodes of Fg and Fg 
in each case is 2r]. 

Table H shows the difference between the moments 
Too, mi, m 2 , mg, TO 4 of and F^. We see that this difference 
is zero exactly for the hrst q moments, q = 1,3, 5. Figure [T] 
shows the difference DFg{s) = F{Fg){s) — F{Fg){s), for 
the frequency s G [0,1]. The normalized difference presented 
on the ordinate is 7^. ffi this hgure we hx q = 0.05, h = 0.1. 
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TABLE I 

Signals parameters 



ai 

^2 

0.3 

Xi 

X 2 

^3 

fO 

1 

1 

1 

— h — 77 


+h + ri 

Fl 

1 

1 

1 

— h — 77 

+rj 

+h + ri 

n 

1 

1 

1 

— h — 77 

-v 

+h + 2 ri 

n 

1 

1 

1 

—h — 2 rj 

+rj 

+h + ri 


-1 - 3?? 

2 + 377 

-1 

—h — 77 

-V 

h + 277 

^5 

-1 

2 + 377 

-1 - 3ij 

—h — 277 

+V 

+h + ri 


TABLE II 

Moments differences 



Amo 

ATni 

Am2 

Amo 

A7714 

Fi 

0 

2rj 

0 

2ri^ 

0 

F 3 

0 

0 

0 

Gh'^rj + IShrj'^ + I 677 ® 

0 

Fs 

0 

0 

0 

0 

0 


6 - 


0.25 0.50 0.75 1.00 

Frequency (s) 


Functions 

. DF1 

• ••• dF3 

DF5 


Fig. 1. Fourier differences DF of the signals from Table 
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